SemanticScuttle - klotz.me

klotz: qlora* + llm* + bitsandbytes* + awq* + quantization methods* + gptq*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. QLoRA with AutoRound: Cheaper and Better LLM Fine-tuning on Your GPU

   The article discusses fine-tuning large language models (LLMs) using QLoRA with different quantization methods, including AutoRound, AQLM, GPTQ, AWQ, and bitsandbytes. It compares their performance and speed, recommending AutoRound for its balance of quality and speed.

   2024-10-09 Tags: qlora, llm fine-tuning, quantization methods, bitsandbytes, gptq, aqlm, awq, llm by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0